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SUMMARY 

This  report  describes  research  on  two  methods  currently  in  use  for  the 
discrimination  of  evoked  potentials.  The  two  methods  are  linear  stepwise 
discriminant  analysis  and  Bayes  or  quadratic  discrimination.  The  particular 
research  discussed  here  is  concerned  with  the  'V'  inverted  'V'  paradigm.  A 
frequent  event  ('V')  and  an  infrequent  event  (inverted  'V')  were  shown  to 
two  subjects  on  4  separate  experiments,  each  experiment  consisting  of  ap¬ 
proximately  550  total  presentations.  Comparison  of  the  performance  of  the 
two  classifiers  when  the  same  data  was  used  to  train  and  test  revealed  that 
the  quadratic  technique  was  more  constant  and  out  performed  the  linear  tech¬ 
nique  in  every  case.  Classification  accuracy  for  these  experiments  was  over 
90%.  When  data  from  different  days  was  used  to  train  and  test  the  classifi¬ 
er,  the  performance  of  both  classifiers  dropped  to  about  70%. 
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INTRODUCTION 


This  report  describes  research  on  two  methods  currently  in  use  for  the 
discrimination  of  evoked  potentials.  The  two  methods  are  linear  stepwise 
discriminant  analysis  and  Bayes  or  quadratic  discrimination.  The  particular 
research  discussed  here  is  concerned  with  the  'V'  inverted  'V'  paradigm.  A 
frequent  event  ('V')  and  an  infrequent  event  (inverted  'V')  were  shown  to 
two  subjects  on  four  separate  experiments,  each  experiment  consisting  of  ap¬ 
proximate  by  550  total  presentations.  Comparison  of  the  performance  of  the 
two  classifiers  when  the  same  data  was  used  to  train  and  test  revealed  that 
the  quadratic  technique  was  more  constant  and  outperformed  the  linear  tech¬ 
nique  in  every  case.  Classification  accuracy  for  these  experiments  was  over 
90%.  When  data  from  different  days  was  used  to  train  and  test  the  classifi¬ 
er,  the  performance  of  both  classifiers  dropped  to  about  70%. 

BACKGROUND 


Linear  Stepwise  Discriminant  Analysis 

The  technique  of  linear  stepwise  discriminant  analysis  (LSDA)  has  been 
used  by  a  number  of  researchers  to  analyze  data  obtained  in  studies  of  event 
related  potentials  (ERP)  CDonchin,  1967,  1970,  1975;  and  Gardiner,  1969 
a,bD.  Typically  data  from  two  or  more  experiments  are  subjected  to  LSDA  to 
ascertain  if  the  recorded  data  are  "different"  and  in  what  ways  they  differ 
the  most.  The  technique  is  linear  in  nature;  i.e.,  it  assumes  that  a  linear 
weighted  sum  of  "features"  will  yield  a  discriminant  score  capable  of  accu¬ 
rately  assessing  the  differences  among  the  elements  of  the  recorded  data 
set . 


The  LSDA  technique  has  been  available  in  a  packaged  form  since  1967 
(Dixon,  1970)  and  has  been  known  as  BMD07M.  Briefly  the  technique  works  as 
follows  (Donchin,  1975): 

Let  the  ERP  following  an  event  be  denoted  by  a  1XN  vector 

A^  =  (a...,  ak  '?'”m'ak ' w^ere  Ntfis  t*,e  r,um*5er  t*me  Points^  and  k  is 
aKk-typeK£iimutls  presented  for  the  i  time.  The  parameter  i  ranges  from  1 
to  P  where  P  is  the  number  of  times  event  K  occurred.  For  example:  let  the 
two  conditions  be  a  click  at  45  dB  above  hearing  threshold  (k.)  and  a  click 
at  30  dB  above  hearing  threshold  (k_).  Each  of  the  two  stimuli  is  presented 
100  times  (P=10Q)  and  80  points,  ICrms  apart  are  recorded  following  each 
stimulus  (N=80).  These  points  are  considered  to  be  random  variables. 

A  total  of  P  1XN  vectors  represents  the  set  of  data  collected  under  any 
of  the  K  conditions.  These  vectors  may  be  arranged  in  a  PXN  matrix  where 
again  k  refers  to  a  particular  type  of  stimulus.  When  K=2,  two  such  matri¬ 
ces  exist,  each  comprising  a  set  of  P  multivariate  observations.  These  ma¬ 
trices  are  fed  into  a  BMD07M  program  which  then  searches  for  a  linear  com¬ 
bination  of  these  variables  that  would  provide  the  maximum  possible  separa¬ 
tion  between  the  k  groups.  The  linear  combination  has  the  effect  of  redu¬ 
cing  each  of  the  N-variate  observations  to  one  number  thereby  reducing  the  K 
N-variate  observations  to  K  univariate  observations. 

A  measure  of  the  separability  between  the  two  groups  is  given  by  the 
ratio  of  the  quantities  W  and  B  is  where  W  is  the  within-group  variability 
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and  B  the  between-group  variability.  Each  linear  combination  of  the  ori¬ 
ginal  variables  produces  a  different  B/W  or  F  ratio  and  obviously  one  would 
like  to  find  the  one  combination  for  which  a  minimum  value  of  the  F  is  ob¬ 
tained.  This  is  by  definition  the  combination  of  variables  which  will  work 
best  (in  the  LSDA  sense)  to  separate  the  K  experimental  groups. 

More  rigorous  definitions  of  B  and  W  are  as  follows:  W,  the  within  - 
class  scatter  matrix  for  class  k  is  given  by 

K 

w  =  £  wk 

k=1  K 

where 

“k  *  £  <aik  -  V  (aik '  V 

a-k  =  the  ith  sample  of  class  k 
=  the  mean  of  class  k 
Nj,  =  the  number  of  samples  of  class  k 
K  =  number  of  classes 

B,  the  between  -  class  scatter  matrix  is  given  by 


B  =  £  n,<M,  -«)«,-«)' 
k  k  ok  o 

where  Mq  is  the  mean  of  all  samples. 

Once  the  variables  have  been  selected  which  yield  the  lowest  F  it  is 
possible  to  compute  a  classification  matrix.  Each  of  the  input  vectors  of 
the  original  matrices  A,  is  classified  into  one  of  the  K  original  classes 
according  to  the  value  of  the  discriminant  function  assigned  to  that  vector. 
This  in  itself  is  a  measure  of  the  effectiveness  of  the  procedure.  Another 
measure  of  effectiveness  computed  by  the  program  is  the  U  statistic.  The 
values  of  this  statistic  range  from  0.0  to  1.0;  the  lower  the  number  the 
greater  the  class  separability. 

The  efficiency  of  the  LSDA  technique  in  the  detection  and  comparison  of 
ERPs  was  tested  by  Donchin  in  1975  (Donchin,  1975).  The  procedure  was  first 
tested  with  data  artificially  generated.  A  data  element  or  vector  was  as¬ 
sumed  to  be  composed  of  the  sum  of  a  deterministic  part  and  a  random  part. 
The  deterministic  part  or  signal  is  that  portion  of  the  brain  potential  re¬ 
lated  directly  to  the  K-type  event  whereas  the  random  part  is  that  portion 
due  to  the  ongoing  EEG.  This  model  may  be  represented  mathematically  as 


( 


a,  . .  =  s,  .  +  n,  .  . 

kit  kit  kit 

where  s  and  n  are  the  signal  and  noise  respectively. 

The  signal  model  was  composed  of  five  damped  sinusoids  and  the  noise 
model  was  generated  by  a  first  order  autoregressive  process  of  the  type 

n,  . .  =  b.n,  Z. 

kit  ki(t-1>  t 

where  b  is  the  autoregressive  constant  for  a  particular  simulated  experiment 
and  Z  is  the  realization  of  a  Gaussian  random  variable  with  a  zero  mean  and 
constant  variance. 

Results  from  this  study  showed  that  for  the  signal  and  noise  models  as¬ 
sumed  the  LSDA  technique  detects  "differences"  in  evoked  potentials.  A  com¬ 
ment  must  be  made,  however,  on  the  order  of  the  autoregressive  model  util¬ 
ized  to  describe  the  on-going  EEG.  On  inspection  of  the  data  characteris¬ 
tics  it  appears  that  the  first  order  model  employed  is  total'.,  inadequate  to 
represent  the  on-going  EEG.  A  first  order  autoregressive  process  has  as  an 
autocorrelation  function  a  decaying  exponential  which  does  not  approximate 
the  autocorrelation  function  of  real  on-going  EEG.  Other  investigators  have 
also  found  that  high  order  models  are  needed  to  adequately  describe  the  on¬ 
going  EEG  (Zetterberg,  1969;  Kaveh,  1978).  These  results  have  also  been 
confirmed  in  our  laboratory  at  Purdue  University.  We  are  currently  in  the 
process  of  examining  this  discrepancy  of  model  order  in  more  detail. 

Bayes  or  Quadratic  Classifier 


The  Bayes  classifier  uses  a  decision  rule  based  on  a  posteriori  proba¬ 
bilities  which  is  designed  to  give  a  minimum  error  or  risk.  If  A  is  a  data 
vector  which  can  belong  to  any  one  of  K  classes  with  known  a  priori  proba¬ 
bilities  P.,...,P  ,  the  a  posteriori  probabilities  can  be  calculated  from 
the  a  priori  probabilities  and  the  conditional  density  functions 
p(A/1 ) ,. . .,p(A/K)  where  p(A/j)  is  the  probability  density  functions  of  A 
given  event  j  occurred.  When  the  costs  of  all  the  different  types  of  errors 
are  the  same,  the  Bayes  decision  rule  to  minimize  the  error  becomes  choosing 
the  class  which  has  the  largest  a  posteriori  probability  or  discriminant 
function: 


h(A)  =  p(A/k)P.  (k  =  1,...,K) 

Thus  the  Bayes  classifier  requires  either  a  knowledge  or  an  estimate  of 
the  conditional  probability  density  functions  p(A/i),...,p(A/K).  In  the 
case  these  density  functions  are  Gaussian  with  expected  vectors  and  co- 
variance  matrices  C.  ,  the  discriminant  functions  can  be  written  as  quadratic 
functions  of  A: 

h  C  A )  =  lnCp(A/k)Pk]  (k  =  1 , K) 
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h(A)  =  In  Pfc  -  1  in|c.|  -  j  (A-Hk)tCk(A-M|()  (k  =  1,...,K> 


When  C  =  C  =  C,  these  quadratic  functions  reduce  to  Linear  functions 
of  A:  1  * 

h(A)  =  Ln  Pk  +  MkC_1A  -  j  M^c"^  <k  =  1,...,K> 

when  C  =  I  the  identity  matrix,  the  Bayes  classifier  become  the  linear 
correlation  classifier 

h(A)  =  In  Pk  +  MkA  -  j  MkMk  Ck  = 


Remembering  that  the  Bayes  classifier  is  optimum  in  the  sense  that  it 
minimizes  the  error,  one  can  see  that  the  linear  classifier  will  always  give 
suboptimum  performance  unless  p(A/1),...p(A/M)  are  Gaussian  with  equal  co- 
variance  matrices.  Thus,  the  linear  classifier  is  an  optimum  classifier 
when  the  additive  noise  is  Gaussian  with  the  same  covariance  for  the  dif¬ 
ferent  classes;  and  the  correlation  classifier  is  an  optimum  classifier 
when,  in  addition,  the  additive  noise  is  white. 

The  selection  of  the  optimum  set  of  features  for  this  type  of  classifi¬ 
cation  remains  largely  an  unsolved  problem.  The  technique  utilized  in  this 
work  is  one  called  forward  sequential  feature  selection  (Fukunaga,  1972). 
Briefly,  this  technique  first  chooses  the  feature  among  all  available 
features  that  gives  the  best  discrimination  using  a  1-dimensional  quadratic 
classifier.  The  next  feature  is  chosen  based  on  the  best  discrimination  for 
a  2-dimensional  classifier  using  the  previously  selected  feature  as  one  of 
the  two.  This  step  of  adding  a  selected  sample  to  the  existing  set  con¬ 
tinues  until  some  predetermined  number  of  features  are  chosen.  This  number 
depends  on  the  total  number  of  observations  available  to  train  the  classifi¬ 
er  . 


Since  there  are  three  electrodes  available  each  contributing  27  possi¬ 
ble  "features",  it  was  decided  to  attempt  classification  utilizing  all  pos¬ 
sible  combination  of  electrodes,  i.e.,  taking  one  electrode  at  a  time;  then 
all  combinations  of  2  electrodes  and  finally  all  combinations  of  three  elec¬ 
trodes. 

Results 


The  results  presented  first  are  for  the  two  subjects,  two  experiments 
each.  The  same  data  used  to  train  the  classifier  was  also  used  to  test  the 
classifier. 


EXPERIMENTAL  DATA 

The  techniques  just  explained,  LSDA  and  Bayes  or  quadratic  classifica¬ 
tion  have  been  tested  utilizing  a  'V'  inverted  'V'  paradigm.  These  tests 
were  conducted  in  order  to  assess  the  appropriateness  of  the  techniques  in 
discriminating  single  evoked  potentials. 
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The  experiment  involved  two  male  graduate  students  as  subjects,  both 
workers  in  the  laboratory,  who  were  comfortably  seated  1.3  meters  in  front 
of  a  visual  display  screen  in  a  room  with  low  ambient  light  level.  These 
two  subjects  were  tested  twice,  the  second  test  being  held  approximately  one 
month  following  the  first.  The  letter  'V'  or  an  inverted  letter  'V',  with 
measurements  2.8  cm  X  2.1  cm  was  flashed  on  the  screen  for  0.75  seconds. 
The  probability  of  a  'V'  appearing  was  set  at  0.9  and  the  probability  of  an 
inverted  'V'  appearing  set  at  0.1.  The  interstimulus  interval  ranged 
between  3  and  5  seconds,  the  actual  time  being  random  with  uniform  distribu¬ 
tion  between  these  limits.  Groups  of  50  or  100  stimuli  were  presented  with 
short  periods  of  rest  between  groups,  until  a  total  of  550  responses  was 
recorded.  The  experiment  ran  for  about  2  hours.  The  brightness  of  the 
stimulus  was  adjusted  to  be  as  bright  as  possible  without  causing  noticeable 
eye  artifact  in  the  eye  channel. 

Beckman  silver-silver  chloride  electrodes  were  applied  with  conductive 
paste  to  sites  Cz,  Pz,  and  Oz  as  determined  by  the  10-20  system  CJasper, 
19583  and  were  referenced  to  linked  mastoids;  forehead  was  used  as  ground. 
In  addition,  an  eye  channel  was  used  to  detect  blink  artifacts.  Electrode 
impedence  was  measured  at  30  Hz  before  and  after  the  experiment  and  was  held 
below  20  kO,  typically  measuring  3-4  k&.  The  signals  were  amplified  by 
Grass  7P511  EEG  amplifiers  with  low  frequency  cutoff  of  0.1  Hz  and  high  fre¬ 
quency  cutoff  of  100  Hz.  Analog-to-digital  conversion  was  accomplished  at  a 
rate  of  250  samples  per  second  with  an  A/D  converter  having  12  bits  of  pre¬ 
cision. 

Data  included  750  msec  of  signal  following  the  initial  stimulation  and 
500  ms  of  data  immediately  preceeding  the  stimulus.  All  data  was  stored  on 
digital  magnetic  tape  as  calibrated  floating  point  microvolt  values. 

Analysis 


All  of  the  records  stored  on  magnetic  tape  were  searched  for  possible 
artifacts  due  to  activity  in  the  eye  channel  (due  to  blinks,  etc.).  The 
criterion  for  rejection  was  a  change  of  amplitude  greater  than  50  mV  within 
any  100  ms  period.  Since  the  probability  of  occurrence  of  an  inverted  'V' 
(IV)  was  arbitrarily  set  at  0.1  (i.e.  the  infrequent  event)  a  total  of 
about  50  IV  responses  were  available  from  the  550  total  responses  obtained. 
A  corresponding  group  of  fifty  V  responses  was  selected  at  random  to  make  up 
the  frequent  event  set. 

The  data  was  digitally  filtered  utilizing  a  low-pass  filter  with  a  cu¬ 
toff  frequency  of  22.5  Hz.  Every  resulting  fifth  data  point  was  used  star¬ 
ting  at  136  ms  after  stimulus  and  ending  656  ms  following  the  stimulus.  A 
total  of  27  points  per  electrode  site  were  thus  obtained.  Initially  a 
visual  inspection  of  the  data  was  performed.  Groups  of  10  single  ERP's  fol¬ 
lowing  the  stimulus  were  plotted  superimposed.  This  was  done  for  both  sets 
of  data.  The  data  was  plotted  from  approximately  140  ms  to  about  650  ms.  A 
qualitative  examination  of  the  data  revealed  that  a  predominantly  positive 
voltage  existed  in  the  area  around  500  ms  for  the  infrequent  event.  This 
result  was  found  to  be  most  prominent  in  the  Pz  electrode.  Both  of  these 
results  were  anticipated  and  confirmed  findings  by  other  investigators  (Don- 
chin,  1975;  1978).  Figures  1  through  16  show  plots  of  the  ERPs  for  these 
tests. 
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Fi.ure  7-  First  subject,  second  test,  I’z  electrode  -  Tests  21-30. 
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Fiujre  9-  Second  subject,  first  test,  ?/.  electrode  Tests  1  - 1 0 . 
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rirjure  10.  Second  subject,  first  test,  Pz  electrode  -  Tests  11-20. 
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i  ‘tore  12.  Second  subject,  first  test,  I'.’  electrode  Tests  31-'(0. 


AHP11TU0E  IN  UV.  /WPIJ 


Second  subject,  second  test 


electrode  -  Tests  I 


i<jure  l!>. 


econd  subject,  second  tost 


electrode  -  Tests  21-30 
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TIME  IN  MS. 
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fi sure  16.  Second  sunjcct,  second  test,  f  *  electrode  -  Tests  31  - 0 . 
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Figures  1  to  4  are  for  the  first  subject,  first  test  and  they  show  the 
first,  second,  third  and  fourth  group  of  superimposed  data  for  the  Pz  elec¬ 
trode.  Only  the  Pz  electrode  is  shown  for  brevity.  The  upper  graph 
corresponds  to  the  infrequent  event  IV  and  the  lower  graph  to  the  frequent 
event  V.  A  horizontal  line  through  zero  microvolts  has  been  added  as  a  re¬ 
ference.  Figures  5  to  8  are  for  the  first  subject,  second  test.  Figures  9 
to  12  are  for  the  second  subject,  first  test.  Figure  13  to  16  are  for  the 
second  subject,  second  test.  The  predominance  of  an  area  of  positivity  in 
the  infrequent  event  is  clearly  evident  about  500  ms  following  stimulation. 
It  is  therefore  anticipated  that  discrimination  techniques  will  tend  to  use 
features  from  this  area  for  discrimination  purposes. 

_A  comment  on  Features. 

Typical  ERP  discrimination  studies  have  utilized  amplitude  values  at 
single  latencies  as  the  "features"  to  be  used  for  discrimination  (Donchin, 
1978).  The“e  is,  however,  no  reason  not  to  try  other  data  measures  to  sup¬ 
plement  or  replace  the  single  latency  values.  Other  types  of  physiological 
discrimination  problems  utilize  very  extensive  descriptions  of  features  or 
properties  in  addition  to  simple  amplitude  values.  For  the  electrocar¬ 
diogram,  157  features  have  been  defined  (Mucciardi,  1970)  such  as:  amplitu¬ 
des  at  selected  time  points,  time  integrals  of  selected  waves,  spatial  maxi¬ 
ma  of  selected  waves,  etc.  The  descriptions  of  some  of  these  features  could 
be  readily  applied  to  the  cognitive  ERP  classification  problem.  It  would 
even  be  logical  to  define  experiment  dependent  features.  For  example,  if  a 
particular  experimental  paradigm  is  designed  to  elicit  a  P3  wave,  such  as 
the  V,  IV  experiment,  then  some  of  the  above  feature  definitions  could  be 
applied  to  the  P3  wave  such  as  energy,  duration  or  moments  about  the  cen¬ 
troid.  It  is  worth  noting,  however,  that  with  the  existing  feature  defini¬ 
tion  (i.e.  the  amplitude  at  a  single  latency)  very  accurate  classification 
results  have  been  obtained  (Sencaj,  1979;  McGillem,  1979). 

Data  Results 


The  results  obtained  for  the  two  subjects  are  quite  extensive.  This  is 
due  to  all  the  possible  permutations  and  combinations  possible.  For  exam¬ 
ple,  the  data  from  the  first  subject,  first  test  was  used  to  train  the  clas¬ 
sifier  and  the  data  from  the  first  subject,  second  test  was  used  to  test  the 
classifier  performance  to  see  if  the  results  were  stable  over  an  extended 
time  period.  All  of  the  tests  were  done  using  both  the  LSDA  technique  and 
the  quadratic  classifier  technique  and  the  quadratic  classifier  was  employed 
using  features  from  the  LSDA  procedure  as  well  as  features  selected  by  the 
forward  sequential  feature  selection  procedure.  In  addition,  all  possible 
combinations  of  electrodes  were  used  to  ascertain  the  existence  of  a  "best" 
electrode  or  electrode  combination.  All  of  the  results  are  shown  in  Tables 
1  to  56. 

Each  table  identifies  the  subject  and  test  number  and  the  code  next  to 
the  title  identifies  which  data  was  used  for  training,  which  for  classifica¬ 
tion  and  the  data  for  which  electrodes  were  available  to  the  classifiers. 
The  first  five  columns  of  each  table  give  results  for  the  LSDA  technique. 
The  first  column  identifies  the  feature  order;  the  second  column  identifies 
the  electrode  site  from  which  the  feature  was  selected;  the  third  column 
gives  the  feature  latency;  the  fourth  column  is  then  classification  accuracy 
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obtained  through  the  LSDA  techniques  and  the  fifth  column  is  the  accuracy 
obtained  utilizing  the  quadratic  classifier  with  the  features  defined  by  the 
LSDA  technique.  The  next  four  columns  give  results  for  the  FSFS  technique, 
the  sixth  column  is  the  feature  order;  the  seventh  column  identifies  the 
electrode  site;  the  eighth  column  gives  the  feature  latency  and  the  ninth 
column  is  the  classification  accuracy  obtained  through  the  FSFS  technique. 
The  classification  accuracy  given  at  any  row  is  the  accuracy  obtained  the 
current  and  preceding  features. 

Table  1 .  First  Subject,  first  experiment.  Same  data  used  to  train  and 

test.  Oz  electrode  used. 

Comments:  LSDA  and  FSFS  picked  the  same  first  2  features;  classification  ac¬ 
curacy  after  2  features  82%  for  LSDA  and  86%  for  FSFS.  First  feature  picked 
appears  to  be  P300.  After  five  features  class,  acc.  for  LSDA  is  85%  and  for 
FSFS  90%. 

Table  2.  First  Sub.,  first  exp.  Same  data  used  to  train  and  test.  Pz 

electrode  used 

Comments:  Same  first  feature  picked  by  LSDA  and  FSFS.  Class,  acc.  after  1 
feature  is  76%.  P300  appears  to  have  been  picked  by  both  techniques.  After 

five  features  class,  acc.  for  LSCA  is  86%  and  for  FSFS  is  94%. 

Table  3.  First  Subj.,  first  exp.  Same  data  used  to  train  and  test.  Cz 

electrode  used. 

Comments:  P300  appears  to  have  been  picked  by  both  techniques.  Initial 
class,  acc.  after  one  feature  for  either  technique  is  about  73%.  Afte  five 
features,  class,  acc.  for  LSCA  is  83%  and  for  FSFS  is  89%. 

Table  4.  First  subject,  first  exp.  Same  data  used  to  train  and  test.  Oz 

and  Pz  electrodes  used. 

Comments:  Note  that  the  data  from  electrodes  2  are  now  available  for  the  two 
techniques  to  pick  features  from.  The  most  conspicuous  result  is  that  the 
LSDA  technique  picked  four  out  of  the  five  features  from  the  Pz  electrode 
achieving  86%  class,  acc.  after  five  features.  On  the  other  hand,  the  FSFS 
technique  picked  three  out  of  the  five  features  from  the  Oz  electrode 
achieving  94%  class,  acc.  after  five  features. 

Table  5.  First  subject,  first  exp.  Same  data  used  to  train  and  test.  Oz 

and  Cz  electrodes  used. 

Comments:  After  five  features  the  LSDA  class,  acc.  is  90%  and  the  FSFS 

class,  acc.  is  94%. 

Table  6.  First  subject,  first  exp.  Same  data  used  to  train  and  test.  Pz 
and  Cz  electrodes  used. 

Comments:  After  five  features  the  LSDA  class  acc.  is  85%  and  the  FSFS 

class,  acc.  is  94%. 

Table  7.  First  subject,  first  exp.  Same  data  used  to  train  and  test.  0£, 
Pz  and  Cz  electrodes  used. 

Comments:  Note  that  the  data  from  all  electrodes  is  now  available  to  both 

techniques.  After  five  features,  the  LSDA  class,  acc.  is  89%  and  the  FSFS 

class,  acc.  is  94% 

General  comments  on  Tables  1  to  7. 

The  amplitude  of  the  area  about  575  ms  was  consistently  picked  first  as 
a  feature  by  either  technique;  this  is  probably  the  location  of  the  "cogni¬ 
tive"  wave  or  P300.  Classification  accuracy  after  5  features  was  as  fol¬ 

lows: 
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Table  1.  Classification  accuracies  obtained  for  subject  1,  test  1  (TRl/CLl;  Oz) 


LSDA  FSFS 


Feature 

S  i  te 

Latency 

Class. 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

576 

75% 

73% 

1 

Oz 

576 

73% 

2 

Oz 

196 

$3% 

86% 

2 

Oz 

196 

86% 

3 

Oz 

276 

m 

81% 

3 

Oz 

176 

88% 

4 

Oz 

*»76 

85% 

84% 

Oz 

216 

863; 

5 

Oz 

336 

85% 

84% 

5 

Oz 

496 

90% 

Table  2. 

Class  i 

fication  accuracies 

obtained  for 

subject  1, 

test  1 

(TRl/CLl ; 

Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class 

.  Accuracy 

Feature 

S  i  te 

Latency 

Class. 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc . -% 

1 

Pz 

576 

76% 

74% 

1 

Pz 

656 

76% 

2 

Pz 

296 

84% 

83% 

2 

Pz 

576 

81% 

3 

Pz 

476 

83% 

81% 

3 

Pz 

276 

88% 

4 

Pz 

156 

84% 

84% 

4 

Pz 

436 

93% 

5 

Pz 

376 

86% 

84% 

5 

Pz 

156 

94% 

Table  3. 

Classification  accuracies 

obtained  for 

subject  1, 

test  l 

(TR1/CL1; 

Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class 

.  Accuracy 

Feature 

S  i  te 

Latency 

Class. 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Cz 

576 

73% 

73% 

1 

Cz 

296 

74% 

2 

Cz 

296 

80% 

80% 

2 

Cz 

556 

84% 

3 

Cz 

476 

83% 

81% 

3 

Cz 

156 

86% 

4 

Cz 

376 

84% 

85% 

4 

Cz 

396 

88% 

5 

Cz 

656 

83% 

86% 

5 

Cz 

276 

89% 
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Table  4.  Classification  accuracies  obtained  for  subject  2,  test  1  (TR1/CLI;  Oz,Pz) 

IS DA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class. 

LSDA 

Accuracy 

HL_ 

Feature 

No. 

Site 

Latency 

ms 

Class. 

Acc.-$ 

1 

Pz 

576 

76$ 

74$ 

1 

Oz 

576 

79$ 

2 

Oz 

196 

84$ 

84$ 

2 

Oz 

196 

86$ 

3 

Pz 

476 

84$ 

85$ 

3 

Pz 

656 

91$ 

4 

Pz 

296 

84$ 

84$ 

4 

Oz 

216 

91$ 

5 

Pz 

216 

86$ 

85$ 

5 

Pz 

296 

94$ 

Table  5.  Classification  accuracies  obtained  for  subject  2,  test  1  (TR1/CL1;  Oz.Cz) 

LSDA  FSFS 

Feature  Site  Latency  Class.  Accuracy  Feature  Site  Latency  Class. 
No.  _  ms  LSDA  ML  No.  _  ms  Acc.-$ 

1  Cz  576  73$  73$  1  Oz  576  79$ 

2  Oz  196  85$  85$  2  Oz  196  86$ 

3  Cz  296  85$  84$  3  Cz  276  90$ 

4  Cz  476  86$  84$  4  Cz  596  94$ 

5  Cz  196  90$  86$  5  Oz  256  94$ 


Table  6. 

Classi 

fication  accuracies 

obtained  for 

subject  1, 

test  1 

(TR1/CL1; 

Pz,Cz) 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class 

.  Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

ML_ 

No. 

ms 

Acc.-$ 

1 

Pz 

576 

76$ 

74$ 

1 

Pz 

656 

76$ 

2 

Cz 

296 

81$ 

84$ 

2 

Pz 

576 

81$ 

3 

Cz 

476 

81$ 

85$ 

3 

Cz 

276 

90$ 

4 

Pz 

176 

85$ 

85$ 

4 

Cz 

416 

93$ 

5 

Cz 

176 

85$ 

86$ 

5 

Pz 

176 

94$ 
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Table  7.  Classification  accuracies  obtained  for  subject  2,  test  1  (TR1/CL1;  0 z,Pz,Cz) 


LSDA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class . 
LSOA 

Accuracy 

ML 

Feature 

No. 

Site 

Latency 

ms 

Class. 

Acc.-% 

1 

Pz 

576 

76% 

74% 

1 

Oz 

576 

79% 

2 

Oz 

196 

m 

84% 

2 

Oz 

196 

86% 

3 

Cz 

296 

85% 

86% 

3 

Pz 

656 

91% 

4 

Cz 

196 

88% 

88% 

4 

Oz 

216 

91% 

5 

Pz 

'♦76 

88% 

89% 

5 

Pz 

296 

94% 

Table  8. 

Classification  accuracies 

obtained  for 

subject  2, 

test  1 

(TRl/CLl ; 

Oz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class 

.  Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

476 

79% 

79% 

1 

Oz 

476 

79% 

2 

Oz 

196 

81% 

82% 

2 

Oz 

136 

82% 

3 

Oz 

136 

86% 

86% 

3 

Oz 

596 

88% 

A 

Oz 

236 

84% 

86% 

4 

Oz 

616 

89% 

5 

Oz 

216 

81% 

85% 

5 

Oz 

256 

91% 

Table  9. 

Classification  accuracies 

obtained  for 

subject  2, 

test  1 

(TRl/CLl; 

Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class 

.  Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc . -% 

1 

Pz 

476 

81% 

81% 

1 

Pz 

476 

81% 

2 

Pz 

516 

83% 

83% 

2 

Pz 

136 

85% 

3 

Pz 

276 

84% 

85% 

3 

Pz 

376 

90% 

4 

Pz 

196 

88% 

88% 

4 

Pz 

256 

89% 

5 

Pz 

136 

91% 

90% 

5 

Pz 

156 

91% 
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Elect rode(s) 

LSDA(%) 

FSFS< 

Oz 

~S5 

“To 

Pz 

86 

94 

Cz 

83 

89 

0z,Pz 

86 

94 

0z,Cz 

90 

94 

Pz,Cz 

85 

94 

0z,Pz,Cz 

88 

94 

For  this  subject,  first  experiment,  the  FSFS  classification  technique 
out-performed  the  LSDA  technique  in  all  cases.  Least  classification  accura¬ 
cy  was  obtained  for  features  from  the  Cz  electrode. 

Table  8.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test .  0£  electrode  used. 

Comments;  LSDA  and  FSFS  picked  the  same  first  feature  which  appears  to  be 
P30(l.  After  five  features  class,  acc.  for  LSDA  is  81%  and  for  FSFS  91%. 
Note  that  after  3  features  LSDA  acc.  was  86%  thereafter  decreasing  to  81%. 
Table  9.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test .  P£  electrode  used. 

Comments:  First  feature  at  476  ms.  picked  by  both  techniques.  After  five 
features  class  acc.  for  LSDA  is  91%  and  for  FSFS  91%. 

Table  10.  Second  subject,  first  experiment.  Same  data  u.sed  to  train  and 

test .  £z  electrode  used. 

Comments;  First  feature  picked  by  both  techniques  are  practically  the  same. 
After  five  features  class,  acc.  for  LSDA  is  71%  and  for  FSFS  is  89%. 

Table  11.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test.  Oz  and  Pz  electrodes  used. 

Comments:  First  feature  picked  by  both  technique  is  from  different  electro¬ 
des  but  at  the  same  latency.  After  five  features  class,  acc.  for  LSDA  is 
85%  and  for  FSFS  is  90%. 

Table  12.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test.  0£  and  Cz  electrodes  used. 

Comments:  Same- Fi rst  feature  picked  by  both  techniques.  After  five  features 
class,  acc.  for  LSDA  is  90%  and  for  FSFS  is  90%. 

Table  13.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test.  Pz  and  Cz  electrodes  used. 

Comments:  Same  first  feature  picked  by  both  techniques.  After  five  features 
class,  acc.  for  LSDA  is  88%  and  for  FSFS  is  89%. 

Table  14.  Second  subject,  first  experiment.  Same  data  used  to  train  and 

test .  0z_,  P£  and  Cz  electrodes  used. 

Comments:  First  features  picked  are  from  different  electrodes  but  at  the 
same  latency.  After  five  features  class,  acc.  for  LSDA  is  92%  and  for  FSFS 
is  93%. 

General  comments  on  Tables  8  to  14. 


After  five  features 


The  amplitude  of  the  area  about  475  ms  was  consistently  picked  first  as 
a  feature  by  each  technique;  as  with  the  first  subject  this  is  probably  the 
location  of  the  "cognitive"  wave  or  P300.  This  wave  had  a  latency  of  575  ms 
for  the  first  subject.  Classification  accuracy  after  5  features  was  as  fol¬ 
lows: 


Table  10.  Classification  accuracies  obtained  for  subject  2,  test  1  (TRl/CLl;  Cz) 


LSDA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class. 

LSDA 

Accuracy 

ML 

Feature 

No. 

Site 

Latency 

ms 

Class. 

Acc.-% 

1 

Cz 

476 

m 

68% 

1 

Cz 

516 

69% 

2 

Cz 

196 

70 % 

71% 

2 

Cz 

256 

75% 

3 

Cz 

256 

73% 

71% 

3 

Cz 

176 

80% 

4 

Cz 

576 

75% 

79% 

4 

Cz 

376 

85% 

5 

Cz 

136 

71% 

79% 

5 

Cz 

596 

89% 

Table  11. 

Classification 

accuracies 

obtained 

for  subject 

2,  test  1 

(TR1/CL1 ; 

Oz,Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

476 

79% 

79% 

1 

Pz 

476 

81% 

2 

0z 

196 

84% 

83% 

2 

Oz 

536 

86% 

3 

Pz 

256 

8l% 

84% 

3 

Oz 

216 

88% 

4 

Oz 

156 

84% 

88% 

4 

Pz 

316 

90% 

5 

Pz 

476 

85% 

89% 

5 

Oz 

316 

90% 

Table  12. 

Classification 

accuracies 

obtained 

for  subject 

2,  test 

1  (TRl/CLl ; 

Oz,Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

476 

79% 

78% 

1 

Oz 

476 

79% 

2 

Oz 

196 

84% 

82% 

2 

Cz 

576 

85% 

3 

Cz 

256 

81% 

81% 

3 

Oz 

176 

86% 

4 

Cz 

376 

90% 

90% 

4 

Oz 

136 

86% 

5 

Cz 

136 

90% 

90% 

5 

Oz 

236 

90% 
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Table  13. 

Classification 

accuracies 

obtained 

for  subject  2 

,  test  1 

(TR1/CLI; 

Pz,Cz) 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class. 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc . ~% 

1 

Pz 

476 

83% 

81% 

1 

Pz 

476 

81% 

2 

Pz 

196 

83% 

83% 

2 

Cz 

216 

86% 

3 

Cz 

436 

m 

84% 

3 

Pz 

336 

89% 

4 

Cz 

276 

86% 

86% 

4 

Pz 

216 

90% 

5 

Cz 

376 

88 % 

90% 

5 

Pz 

156 

89% 

Table  14. 

Classi f ication 

accuracies 

obtained 

for  subject 

2,  test 

1  (TR1/CL1; 

Oz.Pz.Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

476 

79% 

79% 

1 

Pz 

476 

81% 

2 

Oz 

196 

83% 

83% 

2 

Oz 

536 

86% 

3 

Cz 

256 

81% 

81% 

3 

Cz 

376 

89% 

4 

Cz 

376 

90% 

90% 

4 

Oz 

196 

90% 

5 

Pz 

476 

92% 

89* 

5 

Cz 

516 

93% 

Table  15. 

Class 

i  fi  cat  ion 

accuracies 

obta i ned 

for  subject 

1,  test 

2  (TR1/CL1; 

Oz) 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML_ 

No. 

ms 

Acc.-% 

1 

Oz 

496 

64% 

65% 

1 

Oz 

496 

66% 

2 

Oz 

656 

68% 

69% 

2 

Oz 

536 

73% 

3 

Oz 

316 

71% 

7  1% 

3 

Oz 

336 

78% 

4 

Oz 

516 

78% 

73% 

4 

Oz 

156 

78% 

5 

Oz 

136 

70% 

74% 

5 

Oz 

596 

84% 
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Electrode(s) 

LSDA(%) 

FSFSi 

Oz 

5T 

~ 9T 

Pz 

91 

91 

Cz 

71 

89 

0z,Pz 

85 

90 

0z,Cz 

90 

90 

Pz,Cz 

88 

89 

Oz,Pz,Cz 

92 

93 

For  this  subject,  first  experiment,  the  performance  of  the  LSDA  techni¬ 
que  was  equal  to  or  less  than  the  performance  of  the  FSFS  technique.  Clas¬ 
sification  accuracy  obtained  through  the  FSFS  technique  was  very  constant 
ranging  from  89%  to  93%.  On  the  other  hand,  the  accuracy  obtained  with  the 
LSDA  technique  ranged  widely  between  a  low  of  71%  and  a  high  of  92%.  In  no 
case  did  the  accuracy  obtained  under  the  LSDA  technique  outperformed  the  ac¬ 
curacy  obtained  under  the  FSFS  technique.  As  mentioned  earlier  the  FSFS 
technique  yielded  very  consistent  results. 

Table  15.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test .  0£  electrode  used. 

Comments:  Same  first  feature  picked  by  both  techniques.  After  five 
features,  class,  acc.  for  LSDA  is  70%  and  for  FSFS  is  84%.  Note  that  after 
four  features  class,  acc.  for  both  techniques  was  the  same  (78%)  and  with 
the  fifth  feature,  LSDA  dropped  to  70%  and  FSFS  increased  to  84%. 

Table  16.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test .  Pz^  electrode  used. 

Comments:  Same  first  feature  picked  by  both  techniques.  After  five 

features,  class,  acc.  for  LSDA  is  82%  and  for  FSFS  is  91%. 

Table  17.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Cz  electrode  used. 

Comments:  LSDA  technique  picked  as  it's  first  feature  the  amplitude  at  496 
ms,  whereas  FSFS  picked  the  amplitude  at  476  ms.  These  are  adjacent  points 
so  they  should  be  essentially  considered  to  be  the  same  feature.  After  five 
features,  class,  acc.  for  LSDA  is  80%  and  for  FSFS  is  89%. 

Table  18.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Oz  and  Pz  electrodes  used. 

Comments:  Same  first  feature  picked  by  both  techniques.  After  five 

features,  class,  acc.  for  LSDA  is  86%  and  for  FSFS  is  91%. 

Table  19.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test .  Oz  and  Cz  electrodes  used. 

Comments:  First  feature  picked  by  each  technique  is  the  same.  Note  that  un¬ 
der  FSFS,  feature  46  (at  496  ms)  ranked  equally  with  feature  45  (at  476  ms). 
After  five  features,  class,  acc.  for  LSDA  is  82%  and  for  FSFS  is  90%. 

Table  20.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Pz  and  Cz  electrodes  used. 

Comments:  First  feature  picked  by  each  technique  is  the  same.  After  five 
features,  class,  acc.  for  LSDA  is  82%  and  for  FSFS  is  91%. 

Table  21.  First  subject,  second  experiment.  Same  data  used  to  train  and 

test .  Oz,  Pz  and  Cz  electrodes  used. 

Comments:  First  feature  picked by  each  technique  is  the  same.  After  five 
features,  class,  acc.  for  LSDA  is  86%  and  for  FSFS  is  91%. 

General  comments  on  Tables  15  to  21. 


Table  16.  Classification  accuracies  obtained  for  subject  1,  test  2  (TRI/Cll;  Pz) 


LSDA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class . 
LSDA 

Accuracy 

ML 

Feature 

No. 

Site 

Latency 

ms 

Class. 

Acc.-* 

1 

Pz 

496 

76* 

76* 

1 

Pz 

496 

76* 

2 

Pz 

316 

78* 

78* 

2 

Pz 

136 

80* 

3 

Pz 

416 

83* 

84* 

3 

Pz 

376 

84* 

4 

376 

81* 

83* 

4 

Pz 

456 

89* 

5 

Pz 

556 

83* 

84* 

5 

Pz 

656 

91* 

Table  17. 

Classification 

accuracies 

obtained 

for  subject 

1 ,  test 

2  (TR1/CL1; 

Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-* 

1 

Cz 

496 

74* 

74* 

1 

Cz 

476 

74* 

2 

Cz 

416 

75* 

76* 

2 

Cz 

356 

81* 

3 

Cz 

376 

75* 

76* 

3 

Cz 

536 

85* 

4 

Cz 

316 

78* 

79* 

4 

Cz 

616 

88* 

5 

Cz 

636 

80* 

83* 

5 

Cz 

456 

89* 

Table  18. 

Cl as si fi cat  ion 

accuracies 

obtained 

for  subject 

1,  test 

2  (TR1/CL1; 

Oz,Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-' 

Table  19.  Classification  accuracies  obtained  for  subject  1,  test  2  (TRl/CLl;  Qz,Cz) 


Feature 

No. 

Site 

LSDA 

Latency 

ms 

Class . 
LSDA 

Accuracy 

ML 

Feature 

No. 

Site 

FSFS 

Latency 

ms 

Class . 
Acc.-% 

1 

Cz 

496 

74% 

74% 

1 

Cz 

476 

74% 

2 

Oz 

656 

74% 

75% 

2 

Cz 

356 

81% 

3 

Oz 

436 

79% 

79% 

3 

Cz 

536 

85% 

4 

Oz 

316 

81% 

83% 

4 

Oz 

156 

88% 

5 

Cz 

636 

83% 

83% 

5 

Oz 

476 

90% 

Table  20. 

Class! 

v>  ’• 

A 

f ication 

accuracies 

obtained 

for  subject 

1 ,  test  2 

(TRl/CLl ; 

Pz.Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Pz 

496 

76% 

76% 

1 

Pz 

496 

76% 

2 

Pz 

316 

78% 

78% 

2 

Pz 

136 

80% 

3 

Cz 

416 

79% 

80% 

3 

Pz 

376 

84% 

4 

Cz 

376 

81% 

83% 

4 

Pz 

456 

89% 

5 

Pz 

576 

83% 

83% 

5 

Pz 

656 

91% 

Table  21. 

Classi f ication 

accuracies 

obtained 

for  subject 

1,  test 

2  (TRl/CLl; 

0z,Pz,Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

Nc. 

ms 

Acc. -% 

1 

Pz 

496 

76% 

76% 

1 

Pz 

496 

76% 

2 

Oz 

656 

81% 

78% 

2 

Pz 

136 

80% 

3 

Pz 

556 

81% 

74% 

3 

Pz 

376 

84% 

4 

Oz 

316 

84% 

81% 

4 

Pz 

456 

89% 

5 

Cz 

416 

86% 

88% 

5 

Oz 

476 

91% 

The  amplitude  of  the  area  about  496  ms  was  consistently  picked  first  as 
a  feature  by  each  technique;  this  is  probably  the  location  of  the  "cogni¬ 
tive"  wave  or  P300.  Classification  accuracy  after  5  features  was  as  fol¬ 
lows: 

Electrode (s)  LSDA(X)  FSFS(%) 


Oz 

7fi 

St 

Pz 

83 

91 

Cz 

80 

89 

0z,Pz 

86 

91 

0z,Cz 

83 

90 

Pz,Cz 

83 

91 

0z,Pz,Cz 

86 

91 

The  cognitive  wave  (as  defined  by  the  LSDA  and  FSFS  techniques)  had  a 
latency  of  575  ms  for  the  first  experiment  of  this  subject  and  496  ms.  for 
the  second  experiment  of  this  subject.  Performance  of  the  FSFS  technique 
dropped  about  three  percentage  points  from  the  first  test  whereas  the  per¬ 
formance  of  the  LSDA  technique  was  mixed.  Classification  using  FSFS  outper¬ 
formed  LSDA  in  all  cases. 

Table  22.  Second  subject,  second  experiment.  Same  data  used  to  train  and 
test .  0z_  electrode  used. 

Comments:  First  feature  at  496  ms.  picked  by  both  electrodes.  After  five 
features,  class,  acc.  for  LSDA  is  80%  and  for  FSFS  is  88%. 

Table  23.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Pz  electrode  used. 

Comments:  First  feature  picked  by  LSDA  is  at  476  ms.  and  for  FSFS  at  496  ms. 
These  are  adjacent  points  probably  identifying  the  same  wave.  After  five 
features,  class,  acc.  for  LSDA  is  79%  and  for  FSFS  is  86%. 

Table  24.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Cz  electrode  used. 

Comments:  First  feature  picked  by  LSDA  was  at  a  latency  of  476  ms.  After 
five  features,  class,  acc.  for  LSDA  is  79%  and  for  FSFS  is  84%. 

Table  25.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test.  Oz  and  Pz  electrodes  used. 

Comments:  First  feature  picked  by  LSDA  and  FSFS  had  a  latency  of  496  ms. 

After  five  features,  class,  acc.  for  LSDA  is  79%  and  for  FSFS  is  88%. 

Table  26.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test .  0^  and  Cz  electrodes  used. 

Comments:  First  feature  picked  by  LSDA  and  FSFS  had  a  latency  of  496  ms. 

After  five  features,  class,  acc.  for  LSDA  is  79%  and  for  FSFS  is  86%. 

Table  27.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test .  Pz_  and  Cz  electrodes  used. 

Comments:  First  feature  picked  by  LSDA  technique  had  a  latency  of  476  ms 
(tz)  wFereas  the  one  picked  by  FSFS  had  a  latency  of  496  ms  (Pz).  After 

five  features,  class,  acc.  for  LSDA  is  76%  and  for  FSFS  is  86%. 

Table  28.  Second  subject,  second  experiment.  Same  data  used  to  train  and 

test .  Oz,  P£  and  Cz  electrodes  used. 

Comments:  First  feature  picked  by  each  technique  had  the  same  latency  belon¬ 
ging  to  the  same  electrode,  Oz.  After  five  features,  class,  acc.  for  LSDA 
is  80%  and  for  FSFS  is  89%. 

General  comments  on  Tables  22  to  28. 


Table  22. 

Class! fication 

accuracies 

obtained 

for  subject 

2,  test 

2  (TR1/CL1 ; 

Oz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc.-% 

1 

Oz 

496 

69% 

70% 

1 

Oz 

496 

70% 

2 

Oz 

436 

76% 

76% 

2 

Oz 

436 

76% 

3 

Oz 

216 

73% 

76% 

3 

Oz 

156 

73% 

4 

Oz 

316 

75% 

78% 

4 

Oz 

316 

853; 

5 

Oz 

576 

80% 

75% 

5 

Oz 

596 

883; 

Table  23. 

Classi f i 

i  cation 

accuracies 

obtained 

for  subject 

2,  test 

2  (TR1/CL1; 

Pz) 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc 

1 

Pz 

476 

63% 

66% 

1 

Pz 

496 

68% 

2 

Pz 

376 

76% 

7\% 

2 

Pz 

576 

73% 

3 

Pz 

296 

76% 

71% 

3 

Pz 

476 

81% 

4 

Pz 

216 

80% 

84% 

4 

Pz 

196 

81% 

5 

Pz 

576 

73% 

73% 

5 

Pz 

656 

86% 

Table  24. 

Class  if ication 

accuracies 

obtai ned 

for  subject 

2,  test 

2  (TR1/CL1; 

Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Acc .-% 

1 

Cz 

476 

60% 

61% 

1 

Cz 

456 

64% 

2 

Cz 

376 

69% 

68% 

2 

Cz 

176 

69% 

3 

Cz 

296 

79% 

81% 

3 

Cz 

336 

75% 

4 

Cz 

576 

78% 

79% 

4 

Cz 

156 

81% 

5 

Cz 

216 

79% 

86% 

5 

Cz 

416 

86% 
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Table  25.  Classification  accuracies  obtained  for  subject  2,  test  2  (TRl/CLl;  Oz,Pz) 


LSOA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class . 
LSDA 

Accuracy 

ML 

Feature 

No 

Site 

Latency 

ms 

Class . 
Acc.-% 

1 

Oz 

496 

69% 

70% 

1 

Oz 

2*96 

70% 

2 

Oz 

2*56 

76% 

76% 

2 

Oz 

2*56 

76% 

3 

Pz 

296 

76% 

76% 

3 

Oz 

156 

79% 

2* 

Pz 

216 

79% 

80% 

2* 

Oz 

316 

85% 

5 

Pz 

396 

79% 

85% 

5 

Oz 

596 

88% 

Table  26. 

Classification 

accuracies 

obta i ned 

for  subject 

2,  test 

2  (TRl/CLl; 

Oz,Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

S  i  te 

Latency 

Class . 

No. 

ms 

LSDA 

ML 

No. 

ms 

Ac c. -% 

1 

Oz 

2*96 

69% 

70% 

1 

Oz 

2*96 

70% 

2 

Cz 

2*76 

73% 

71% 

2 

Oz 

2*36 

76% 

3 

Cz 

296 

75% 

7^% 

3 

Cz 

336 

80% 

2* 

Oz 

2*36 

79% 

76% 

4 

Oz 

156 

83% 

5 

Cz 

376 

79% 

80% 

5 

Oz 

2*76 

86% 

Table  27. 

Class*  fi cat  ion 

accuracies 

obtained 

for  subject 

2,  test 

2  (TRl/CLl; 

Pz, Cz) 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class  . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

•ns 

LSDA 

ML_ 

No. 

ms 

Acc.-% 

1 

Cz 

476 

60% 

61% 

1 

Pz 

2*96 

68% 

2 

Pz 

296 

73% 

73% 

2 

Pz 

576 

73% 

3 

Cz 

376 

73% 

73% 

3 

Pz 

4  76 

81% 

2* 

Pz 

576 

74% 

71% 

4 

Pz 

196 

81% 

5 

Pz 

656 

76% 

79% 

5 

Pz 

656 

86% 
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Table  28.  Classification  accuracies  obtained  for  subject  2,  test  2  (TR1/CL1;  Oz,Pz,Cz) 


LSDA  FSFS 


Feature 

No. 

Si  te 

Latency 

ms 

Class . 
LSDA 

Accuracy 

ML 

Feature 

No. 

Site 

Latency 

ms 

Class. 

Acc.~% 

1 

Oz 

1*96 

69% 

70% 

1 

Oz 

1*96 

70% 

2 

Oz 

1*36 

74% 

76% 

2 

Oz 

1*36 

76% 

3 

Pz 

376 

75% 

78% 

3 

Cz 

336 

80% 

4 

Cz 

296 

79% 

79% 

1* 

Pz 

296 

85% 

5 

Cz 

1*76 

80% 

80% 

5 

Oz 

356 

89% 

Table  29- 

Classification 

accurac i es 

obta i ned 

for  subject 

1,  test 

1  and  2  (TR1/CL2;  Os 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

S  i  te 

Latency 

Class. 

No. 

ms 

LSDA 

ill 

No. 

ms 

Acc. -% 

1 

Oz 

576 

60% 

63% 

1 

Oz 

576 

63% 

2 

Oz 

196 

59% 

*  58% 

2 

Oz 

796 

58% 

3 

Oz 

276 

58% 

55% 

3 

Oz 

176 

59% 

i* 

Oz 

1*76 

63% 

58% 

1* 

Oz 

218 

59% 

5 

Oz 

336 

61% 

61% 

5 

Oz 

1*96 

65% 

Table  30. 

Classification 

accuracies 

obta i ned 

for  subject 

1,  test 

1  and  2  (TR1/CL2;  Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

Ho. 

ms 

Acc . -% 

1 

Pz 

576 

68% 

69% 

I 

Pz 

656 

56% 

2 

Pz 

296 

64% 

63% 

2 

Pz 

576 

59% 

3 

Pz 

476 

74% 

73% 

3 

Pz 

276 

59% 

'* 

Pz 

156 

73%  , 

78% 

4 

Pz 

436 

65% 

5 

Pz 

376 

74% 

76% 

5 

Pz 

156 

64% 

-  39  - 


The  amplitude  of  the  area  about  496  ms  was  consistently  picked  first  by 
each  technique.  This  represents  an  increase  of  about  20  ms  in  latency  from 
the  first  experiment.  This  is  probably  not  a  significant  difference.  As 
previously  stated,  this  is  probably  the  location  of  the  "cognitive"  wave. 
Classification  accuracy  after  5  features  was  as  follows: 

Electrode(s)  LSDA(%)  FSFS(%) 


Oz 

Pz 

79 

86 

Cz 

79 

86 

0z,Pz 

79 

88 

0z,Cz 

79 

86 

Pz,Cz 

76 

86 

Oz,Pz,Cz 

80 

89 

Table  29.  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz 
electrode  used. 

Comments:  Overall  accuracy  when  using  different  samples  to  train  and  to  test 
is  considerably  lower  than  before.  A  possible  explanation  may  be  as  fol¬ 
lows:  For  the  first  experiment  (electrode  Oz)  features  picked  by  the  FSFS 
classifier  were  located  at  176,  196,  216,  496  and  576  ms  respectively.  For 
the  second  test  they  were  located  at  156,  336,  496,  536  and  596  ms  respec¬ 
tively.  First  features  picked  were  located  at  576  and  496  ms  respectively. 
It  is  therefore  not  surprising  that  when  the  features  from  the  first  set  of 
tests  were  used  to  classify  the  second  set  of  tests  a  substantially  lower 
classification  rate  was  obtained. 

If  the  location  of  the  first  feature  picked  is  indicative  of  the  loca¬ 
tion  of  the  cognitive  wave  P300  then  one  can  see  that  the  location  of  P300 
has  changed  from  the  first  to  the  second  test.  Only  one  feature  was  picked 
both  times,  the  one  located  at  496  ms.  It  appears  as  if  the  character  and 
perhaps  the  complexity  of  the  waveform  have  changed  over  the  period  of  time 
between  the  two  tests.  This  may  be  due  to  subject  habituation,  or  perhaps  a 
lack  of  an  adequate  experimental  paradigm.  Another  possible  explanation  may 
be  found  in  the  way  that  FSFS  picks  features.  During  any  step  in  the  pro¬ 
cedure  several  features  may  be  found  any  one  of  which  may  yield  the  same 
classification  accuracy.  For  example,  in  Table  1,  third  step,  three 
features  were  found  that  woulds  yield  the  same  class,  acc.  and  these 
features  were  located  at  176,  216  and  256  ms  respectively.  When  faced  with 
more  than  one  feature  that  yields  the  same  accuracy,  and  with  no  added  in¬ 
formation,  the  program,  in  a  very  arbitrary  manner,  picks  the  feature  with 
the  fastest  latency.  So  in  the  example  just  given,  it  picked  the  feature  at 
176  ms.  At  the  next  step,  nine  features  were  found  that  would  yield  the 
same  accuracy.  Again  the  process  was  repeated.  So  only  one  of  a  possibly 
very  large  number  of  trees  was  followed;  i.e.,  the  feature  at  176  ms.  Ob¬ 
viously,  this  is  not  an  exhaustive  search  and  undoubtedly  leads  to  a  subop- 
timal  set  of  features. 

After  five  features,  class,  acc.  for  LSDA  is  61%  and  for  FSFS  is  65%. 
Table  30.  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Pz 
electrode  used. 

Comments: 


As  with  electrode  Oz,  class,  acc.  of  FSFS  is  low.  After  five  features, 
it  is  only  64%.  The  results  obtained  with  the  LSDA  technique  and  with  LSDA 
features  picked  FSFS  class,  technique  (blocks  9,  10  and  11)  are  also  equal¬ 
ly  lower.  For  the  first  time,  classification  accuracy  using  LSDA  surpasses 
accuracy  obtained  by  FSFS.  It  is  also  interesting  to  note  that  the  accuracy 
obtained  in  column  5  is  now  greater  than  the  conventional  LSDA  accuracy. 
Numbers  given  in  column  5  are  the  accuracy  obtained  using  features  picked  by 
the  LSDA  technique  (given  in  column  3). 

It  is  difficult  to  explain  the  nature  of  the  above  changes.  One  may 
surmise  that  an  explanation  may  lie  in  the  inherent  differences  between  the 
two  techniques.  The  LSDA  simply  weights  the  amplitudes  at  certain  latencies 
and  linearly  combines  them.  The  FSFS  depends  on  the  covariance  of  the  sam¬ 
ples  at  the  different  latencies.  The  fact  that  the  accuracy  obtained  in 
column  5  is  larger  than  the  accuracy  obtained  in  column  4  still  points 
towards  the  superiority  of  FSFS  as  a  classification  technique. 

After  five  features  class,  acc.  for  LSDA  was  75%  (also  achieved  after  3 
features)  and  for  FSFS  it  was  64%  (after  4  features  it  achieved  65%). 

Table  31 .  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Cz 
electrode  used. 

Comments;  Comments  made  in  the  discussion  of  the  preceeding  table  also  apply 
here.  Maximum  classification  accuracy:  LSDA,  69%  after  3  features  and  FSFS, 
63%  after  5  features. 

Table  32.  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz  and  Pz 
electrodes  used. 

Comments: 

An  additional  type  of  test  was  done  with  this  data.  The  results  given 
in  the  last  three  tables  were  computed  as  follows  (for  the  FSFS  technique): 
the  features  and  the  corresponding  covariance  matrix  needed  by  the  quadratic 
classifier  were  computed  from  the  first  test  and  then  each  data  vector  from 
the  second  test  classified.  An  alternate  way  would  be  to  select  the 
features  from  the  first  test  but  to  compute  the  covariance  matrix  from  the 
second  test.  The  re-definition  of  the  covariance  matrix  improved  the  clas¬ 
sification  accuracy  by  approximately  10%. 

Maximum  classification  accuracy:  LSDA:  73%  after  4  features;  FSFS:  63%  after 
1  feature;  FSFS  with  re-defined  covariance  matrix:  74%  after  4  features. 
Table  33.  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz  and  Cz 
electrodes  used. 

Comments:  Overall  accuracy  was  low  for  both  LSDA  and  FSFS.  Maximum  classi¬ 
fication  accuracy:  LSDA:  66%  after  5  features;  FSFS:  63%  after  1  feature; 
FSFS  with  re-defined  covariance  matrix:  60%  after  5  features. 

Table  34.  First  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Pz  and  Cz 
electrodes  used. 

Comments:  Redefining  the  covariance  matrix  had  the  effect  of  increasing 
overall  classification  accuracy  to  almost  80%.  Maximum  classification  accu¬ 
racy:  LSDA:  69%  after  3  features;  FSFS:  66%  after  5  features;  FSFS  with 
redefined  covariance  matrix:  79%  after  5  features. 

Table  35.  First  subject,  first  and  second  experiment.  Data  from  first  ex- 
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Table  31.  Classification  accuracies  obtained  for  subject  1,  test  1  and  2  (TR1/CL2;  Cz) 

LSDA  FSFS 


Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc . -% 

1 

Cz 

576 

56% 

53% 

1 

Cz 

296 

5^% 

2 

Cz 

296 

65% 

63% 

2 

Cz 

556 

61% 

3 

Cz 

A76 

68% 

69% 

3 

Cz 

156 

61% 

A 

Cz 

376 

68% 

68| 

A 

Cz 

396 

61% 

5 

Cz 

656 

66% 

70% 

5 

Cz 

276 

63% 

Table  32.  Classification  accuracies  obtained  for  subject  1,  test  1  and  2  (TR1/CL2;  Oz,Pz) 

LSDA  FSFS 


Feature 

Si  te 

Latency 

Class . 

Accuracy 

Feature 

S  i  te 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

I 

Pz 

576 

68% 

69% 

I 

Oz 

576 

63% 

2 

Oz 

196 

63% 

65% 

2 

Oz 

196 

58% 

3 

Pz 

A76 

71% 

73% 

3 

Pz 

656 

58% 

A 

Pz 

296 

73% 

73% 

A 

Oz 

216 

60% 

5 

Pz 

216 

71% 

73% 

5 

Pz 

296 

5A% 

Table  33. 

Classification 

accuracies 

obtained 

for  subject 

1,  test 

1  and  2  (TR1/CL2;  Oz 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class. 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

1 

Cz 

576 

59% 

60% 

1 

Oz 

576 

63% 

2 

Oz 

196 

61% 

6A% 

2 

Oz 

196 

58% 

3 

Cz 

296 

55% 

61% 

3 

Cz 

276 

53% 

A 

Cz 

476 

65% 

65% 

A 

Cz 

596 

58% 

5 

Cz 

196 

66% 

68% 

5 

Oz 

256 

60% 

-  A2  - 


periment  used  to  train,  data  from  second  experiment  used  to  test.  0 z,  Pz 

and  Cz  electrodes  used. 

.  Comments:  Maximum  classification  accuracy:  LSDA:  74%  after  5  features;  FSFS: 
60%  after  4  features;  FSFS  with  redefined  covariance  matrix:  74%  after  5 
features. 

General  comments  on  Tables  29  t£  35_. 

Classification  accuracy  has  been  reduced  by  utilizing  features  and 
results  from  one  test  to  train  a  classifier  used  to  classify  samples  from  a 
different  test.  It  appears  as  if  LSDA  is  more  impervious  to  changes  of  this 
type  than  FSFS.  This  may  be  corrected,  however,  by  a  more  extensive  study 
of  the  feature  selection  process  of  the  FSFS  technique.  This  is  evidenced 
by  the  results  given  in  column  or  block  11.  Redefining  the  covariance  ma¬ 
trix  improved  the  classification  accuracy  by  as  much  as  10%. 

Maximum  Classification  Accuracy: 


Electrode(s) 

LSDA(%-#  of  features) 

FSFS  (%— #  of  features) 

FSFS-redef ine 
cov.  matrix 
(%-#  of  features) 

Oz 

63(4) 

65(5) 

- 

Pz 

74(3) 

65(4) 

Cz 

68  (3) 

63(5) 

0z,Pz 

73(4) 

63(1) 

74(5) 

Oz,Cz 

66(5) 

63(1) 

60(5) 

Pz,Cz 

69(3) 

66(4) 

79(5) 

Oz,Pz,Cz 

74(5) 

63(1) 

74(5) 

Table  36.  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz 
electrode  used. 

Comments:  Most  of  the  comments  made  during  the  analysis  of  tables  29  to  35 
also  apply  here.  General  class,  acc.  has  been  lowered  by  using  different 
data  to  train  and  test.  Maximum  classification  accuracy:  LSDA:  66%  after  2 
features;  FSFS:  69%  after  2  features. 

Table  37.  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Pz 
electrode  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  66%  after  5  features;  FSFS: 
71%  after  5  features. 

Table  33.  Second  subject,  first  and  second  experiment.  Data  from  first  ex- 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Cz 
electrode  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  68%  after  3  features;  FSFS: 
73%  after  4  features. 

Table  39.  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz  and  Pz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  66%  after  2  features;  FSFS: 
66 after  4  features. 

Table  40.  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz  and  Cz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  64%  after  1  feature;  FSFS: 
66%  after  2  features. 


Table  34.  Classification  accuracies  obtained  for  subject  1,  test  1  and  2(TRl/CL2;Pz,Cz) 


Feature 

No. 

Site 

LSDA 

Latency 

ms 

Class . 
LSDA 

Accuracy 

MS_ 

Feature 

No. 

Si  te 

FSFS 

Latency 

ms 

Class 

Acc.-I 

1 

Pz 

576 

681 

69% 

1 

Pz 

656 

56% 

2 

Cz 

296 

60% 

60% 

2 

Pz 

576 

59% 

3 

Cz 

476 

69% 

70% 

3 

Cz 

276 

65% 

4 

Pz 

176 

69% 

71% 

4 

Cz 

416 

66% 

5 

Cz 

176 

69% 

70% 

5 

Pz 

176 

66% 

Table  35. 

Class i f ication 

accuracies 

ob tained 

for  subject 

1,  test  1 

1  and  2(TRl/CL2;0z 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-I 

1 

Pz 

576 

68% 

69% 

1 

Oz 

576 

63% 

2 

Oz 

196 

65% 

65% 

2 

Oz 

196 

58% 

3 

Cz 

296 

59% 

61% 

3 

Pz 

656 

58% 

4 

Cz 

196 

58% 

63% 

4 

Oz 

216 

60% 

5 

Pz 

476 

74% 

73% 

5 

Pz 

296 

54% 

*  Table  36. 

Class  if ication 

accuracies 

obtained 

for  subject 

2,  test 

1  and  2(TRl/CL2;0z) 

t 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

l  1 

Oz 

476 

64% 

64% 

1 

Oz 

476 

64% 

1  2 

Oz 

196 

66% 

68% 

2 

Oz 

136 

69% 

|.  3 

Oz 

136 

64% 

65% 

3 

Oz 

596 

68% 

1  '  4 

Oz 

236 

63% 

64% 

4 

Oz 

616 

61% 

1  5 

Oz 

216 

60% 

59% 

5 

Oz 

256 

56% 

SI 


Table  37- 

Classi 

fi cat  ion 

accuracies 

obtained 

for  subject 

2,  test 

1  and  2(TRl/CL2;Pz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

_ms 

LSDA 

Ill 

Ho. 

ms 

Acc . -2 

1 

Pz 

476 

6  32 

642 

1 

Pz 

476 

632 

Pz 

516 

562, 

592 

2 

Pz 

136 

682 

3 

Pz 

276 

5132 

582 

3 

Pz 

376 

642 

4 

Pz 

196 

642 

612 

4 

Pz 

256 

662 

5 

Pz 

136 

662 

682 

5 

Pz 

156 

712 

Table  38- 

C 1  ass  i 

f? cat  ion  a 

iccurac  ies 

obtained 

for  subject 

2,  test 

1  and  2(TRl/CL2;Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

S  i  te 

Latencv 

Class . 

No. 

ms 

LSDA 

MS 

Ho. 

ms 

Acc. -2 

1 

Cz 

476 

602 

612 

1 

Cz 

516 

65' 

2 

Cz 

196 

532 

592 

2 

Cz 

256 

6 1 2 

3 

Cz 

256 

682 

642 

3 

Cz 

176 

652 

4 

Cz 

576 

682 

652 

4 

Cz 

376 

732 

5 

Cz 

136 

652 

642 

5 

Cz 

596 

642 

Taole  39. 

Class i 

if ication 

accurac i es 

obtained 

for  subject 

2,  test 

1  and  2  (TR1 /CL2 ; Oz , Pz) 

LSDA 

FSFS 

Feature 

S  i  te 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. _ 

ms  _ 

LSDA 

MS 

__Ho_. _ 

ms 

Acc. -2 

i 

Oz 

476 

642 

642 

1 

Pz 

476 

632 

Oz 

196 

662 

642 

2 

Oz 

536 

632 

J 

Pz 

256 

592 

612 

3 

Oz 

216 

652 

'♦ 

Oz 

156 

652 

612 

4 

Pz 

316 

662 

Pz 

476 

612 

602 

5 

Oz 

316 

642 

Table  41 .  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Pz  and  Cz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  63%  after  1  feature;  FSFS: 
66%  after  5  features. 

Table  42.  Second  subject,  first  and  second  experiment.  Data  from  first  ex¬ 
periment  used  to  train,  data  from  second  experiment  used  to  test.  Oz,  Pz 
and  Cz  electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  66%  after  2  features;  FSFS: 
66%  after  3  features. 

General  comments  on  Tables  36  t£  4£. 

General  comments  made  for  the  proceeding  set  of  tables  also  apply  here. 
Overall  accuracy  has  been  lowered,  performance  of  LSDA  and  FSFS  are  about 
equal.  Maximum  classification  accuracy: 


Electrode(s) 

LSDA<%-#  of  features) 

FSFS(%-#  of  features) 

Oz 

66(2) 

69(2) 

Pz 

66(5) 

71(5) 

Cz 

65(4) 

73(4) 

0z,Pz 

66(2) 

66(4) 

0z,Cz 

66(2) 

66(2) 

Pz,Cz 

63(1) 

66(5) 

0z,Pz,Cz  . 

66(2) 

66(3) 

In  the  following  series  of  tests,  data  from  the  first  subject  was  used 
to  train  the  classifiers  and  data  from  the  second  subject  was  used  to  test 
the  classifiers. 

Table  43.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Oz  electrode 
used. 

Comments:  In  a  quasi-anticipated  result,  overall  classification  accuracy  has 
decreased.  Maximum  classification  accuracy:  LSDA:  63%  after  4  features; 
FSFS:  68%  after  4  features. 

Table  44.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Pz  electrode 
used. 

Comments:  Maximum  classification  accuracy:  LSDA:  73%  after  2  features;  FSFS: 
65%  after  2  features. 

Table  45.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Cz  electrode 
used. 

Comments:  Maximum  classification  accuracy:  LSDA:  68%  after  2  features;  FSFS: 
65%  after  2  features. 

Table  46.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Oz  and  Pz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  70%  after  5  features;  FSFS: 
71%  after  1  feature. 

Table  47.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Oz  and  Cz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  68%  after  3  features;  FSFS: 


Table  40. 

Classification 

accuracies 

obtained 

for  subject 

2,  test 

1  and  2(TRl/CL2;0z,Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class. 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

1 

Oz 

476 

64% 

64% 

1 

Oz 

476 

64% 

2 

Oz 

196 

66% 

68% 

2 

Cz 

576 

66% 

3 

Cz 

256 

63% 

64% 

3 

Oz 

176 

61% 

4 

Cz 

376 

64% 

64% 

4 

Oz 

136 

64% 

5 

Cz 

136 

63S 

65% 

5 

Oz 

236 

58% 

Table  41. 

Classification 

accuracies 

obtained 

for  subject 

2,  test 

1  and  2(TRl/CL2;Pz,Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class. 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

MS_ 

No. 

ms 

Acc.-% 

1 

Pz 

476 

63? 

64% 

1 

Pz 

476 

63% 

2 

Pz 

196 

57? 

59? 

2 

Cz 

216 

65% 

3 

Cz 

436 

55? 

58? 

3 

Pz 

336 

60% 

4 

Cz 

276 

57% 

56% 

4 

Pz 

216 

63% 

5 

Cz 

376 

61% 

63? 

5 

Pz 

156 

66% 

Table  42. 

Classification 

accuracies 

obtained 

for  subject 

2,  test 

1  and  2(TRI/CL2;0z,Pz, 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

1 

Oz 

476 

64% 

64% 

1 

Pz 

476 

63% 

2 

Oz 

196 

66% 

68% 

2 

Oz 

536 

63% 

3 

Cz 

256 

63? 

64% 

3 

Cz 

376 

66% 

4 

Cz 

376 

64% 

65? 

4 

Oz 

196 

65% 

5 

Pz 

476 

66% 

68% 

5 

Cz 

516 

66% 
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‘  Table  43. 

Classification 

accuracies 

obtained 

for  subject 

1  and  2, 

test  1 (TR1/CLI ;0z) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.~% 

1 

Oz 

576 

592 

64% 

1 

Oz 

576 

64% 

2 

Oz 

196 

6  1% 

63% 

2 

Oz 

196 

63% 

;  3 

Oz 

276 

60% 

59% 

3 

Oz 

176 

60% 

4 

Oz 

476 

63% 

58% 

4 

Oz 

216 

68% 

5 

1 

Oz 

336 

61% 

592 

5 

Oz 

496 

63% 

j  Table  44. 

Class  i 

fication 

accuracies 

obtained 

for  subject 

1  and  2, 

test  1 (TR1/CL1 ;Pz) 

' 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-% 

1 

Pz 

576 

68% 

71% 

1 

Pz 

656 

74% 

2 

Pz 

296 

73% 

74% 

2 

Pz 

576 

75% 

3 

Pz 

476 

71% 

70% 

3 

Pz 

276 

71% 

4 

Pz 

156 

692 

65% 

4 

Pz 

436 

65% 

5 

Pz 

376 

70% 

69% 

5 

Pz 

156 

68% 

Table  45. 

Class i 

fication  < 

accuracies 

obtained 

for  subject 

1  and  2, 

test  1 (TRl/CLl;Cz) 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Si  te 

Latency 

Class . 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc . -% 

1 

Cz 

576 

64% 

65% 

1 

Cz 

296 

60% 

2 

Cz 

296 

68% 

59% 

2 

Cz 

556 

65% 

3 

Cz 

476 

61% 

54% 

3 

Cz 

156 

64% 

4 

Cz 

376 

59% 

61% 

4 

Cz 

396 

61% 

5 

Cz 

656 

68% 

68% 

5 

Cz 

276 

59% 
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Table  46. 

Classification 

accuracies 

obtained 

for  subject  1 

and  2, 

test  1 (TR1/CL1 ;Oz,l 

LSOA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc .-% 

1 

Pz 

576 

683 

m 

1 

Oz 

576 

7\% 

2 

Oz 

196 

69% 

64* 

2 

Oz 

196 

63% 

3 

Pz 

476 

613 

60% 

3 

Pz 

656 

56% 

4 

Pz 

296 

63% 

65% 

4 

Oz 

216 

70% 

5 

Pz 

216 

70% 

7\% 

5 

Pz 

296 

69% 

Table  47- 

Classification 

accuracies 

obtained 

for  subject 

1  and  2, 

test  1 (TR1/CL1 ;0z,( 

LSDA 

FSFS 

Feature 

Site 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc.-3 

1 

Cz 

576 

643 

65% 

1 

Oz 

576 

643 

2 

Oz 

196 

65% 

613 

2 

Oz 

196 

63% 

3 

Cz 

296 

66% 

683 

3 

Cz 

276 

603 

4 

Cz 

476 

613 

643 

4 

Cz 

596 

59% 

5 

Cz 

196 

63% 

59% 

5 

Oz 

256 

64% 

Table  48. 

Classification 

accuracies 

obtained 

for  subject 

1  and  2, 

test  1 (TRJ/CLI;Pz,< 

LSDA 

FSFS 

Feature 

Si  te 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class. 

No. 

ms 

LSDA 

MS 

No. 

ms 

Acc. -3 

1 

Pz 

576 

683 

713 

1 

Pz 

656 

74% 

2 

Cz 

296 

653 

613 

2 

Pz 

576 

71% 

3 

Cz 

476 

683 

683 

3 

Cz 

276 

74% 

4 

Pz 

176 

65% 

683 

4 

Cz 

416 

68% 

5 

Cz 

176 

613 

59% 

5 

Pz 

176 

643 
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64%  after  1  feature. 

Table  48.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject  used  to  train,  data  from  second  subject  used  to  test.  Pz  and  Cz 
electrodes  used. 

Comments;  Maximum  classification  accuracy:  LSDA:  68%  after  1  feature;  FSFS: 
74%  after  1  feature. 

Table  49.  First  and  second  subject,  first  experiment.  Data  from  first  sub¬ 
ject-  used  to  train,  data  from  second  subject  used  to  test.  Oz,  Pz  and  Cz 
electrodes  used. 

Comments;  Maximum  classification  accuracy:  LSDA:  68%  after  1  feature;  FSFS: 
69%  after  3  features. 

General  comments  on  Tables  43  to  49. 

The  results  just  described  represent  an  attempt  at  classifying  the  data 
for  one  subject,  using  results  from  another  subject.  On  the  average,  the 
classification  accuracy  was  poor  (about  70%)  with  neither  technique  having 
an  apparent  advantage  over  the  other.  Maximum  classification  accuracy: 


Electrode(s) 

LSDA (%-#  of  features) 

FSFS(X-0  of 

Oz 

63(4) 

68(4) 

Pz 

73(2) 

75(2) 

Cz 

68(2) 

65(2) 

Oz,Pz 

70(5) 

71  (1) 

0z,Cz 

68(3) 

64(1) 

Pz,Cz 

68(1) 

74(1) 

0z,Pz,Cz 

68(1) 

69(3) 

In  the  following  series  of  tests,  data  from  the  second  subject,  second  ex¬ 
periment  was  used  to  train  the  classifiers  and  data  from  the  first  subject, 
second  experiment  used  to  train  the  classifiers. 

Table  50.  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Oz  electrode 
used. 

Comments:  General  accuracy  of  this  series  of  tests  is  low.  Practically  no 
difference  between  this  series  of  tests  and  the  results  given  in  Tables  43 
to  49  was  found.  Overall  class,  acc.  was  found  to  be  about  65  -  70%. 
Maximum  classification  accuracy:  LSDA:  64%  after  1  feature;  FSFS:  68%  after 
i  feature. 

Table  51 .  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Pz  electrode 
used. 

Comments:  Maximum  classification  accuracy:  LSDA:  76%  after  2  features;  FSFS: 
?6X  after  1  feature. 

Table  52.  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Cz  electrode 
used. 

Comments:  Maximum  classification  accuracy:  LSDA:  71%  after  2  features;  FSFS: 
73%  a'fter  1  feature. 

Tabte  53.  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Oz  and  Pz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  65%  after  1  feature;  FSFS: 
68%  after  1  feature. 

Table  54.  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Oz  and  Cz 
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Table  49.  Classification  accuracies  obtained  for  subject  1  and  2,  test  1 (TR1/CL1 ;0z,Pz,Cz) 


Feature 

No. 

Site 

LSDA 

Latency 

ms 

1 

Pz 

576 

2 

Oz 

196 

3 

Cz 

296 

4 

Cz 

196 

5 

Pz 

476 

Class . 

Accuracy 

Feature 

LSDA 

MS 

No. 

681 

71% 

1 

63% 

64% 

2 

68% 

6g% 

3 

61% 

59% 

4 

64% 

61% 

5 

FSFS 


Site  Latency  Class. 

ms  Acc.-% 


Oz 

576 

64% 

Oz 

196 

63% 

Pz 

656 

69% 

Oz 

216 

68% 

Pz 

296 

65% 

Table  50.  Classification  accuracies  obtained  for  subject  1  and  2,  test  2(TR2/CL2;0z) 

LSDA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class . 
LSDA 

Accuracy 

MS 

Feature 

No. 

Si  te 

Latency 

ms 

Class . 
Acc.-% 

1 

Oz 

496 

64% 

68% 

1 

Oz 

496 

68% 

2 

Oz 

436 

62% 

63% 

2 

Oz 

436 

63% 

3 

Oz 

216 

60% 

64% 

3 

Oz 

156 

68% 

4 

Oz 

296 

58% 

54% 

4 

Oz 

316 

63% 

5 

Oz 

576 

58% 

51% 

5 

Oz 

596 

61% 

Table  51.  Classification  accuracies  obtained  for  subject  1  and  2,  test  2 (TR2/CL2; Pz) 

LSDA  FSFS 


Feature 

No. 

Site 

Latency 

ms 

Class . 
LSDA 

Accuracy 

MS 

Feature 

No. 

Si  te 

Latency 

ms 

Class . 
Acc.-% 

1 

Pz 

476 

70% 

69% 

1 

Pz 

496 

76% 

2 

Pz 

376 

76% 

76% 

2 

Pz 

576 

73% 

3 

Pz 

296 

71% 

73% 

3 

Pz 

476 

70% 

4 

Pz 

216 

68% 

64% 

4 

Pz 

196 

64% 

5 

Pz 

576 

71% 

68% 

5 

Pz 

656 

66% 
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Table  52.  Classification  accuracies  obtained  for  subject  1  and  2,  test  2 (TR2/CL2 ;Cz) 


Feature 

No. 


Si  te 

Latency 

Class . 

Accuracy 

Feature 

Site 

Latency 

Class . 

ms 

LSDA 

MS 

No. 

ms 

Acc.-2 

Cz 

476 

70 2 

73% 

1 

Cz 

456 

732 

Cz 

376 

712 

79% 

2 

Cz 

176 

632 

Cz 

296 

642 

662 

3 

Cz 

336 

642 

Cz 

576 

e\% 

692 

4 

Cz 

156 

632 

Cz 

216 

642 

7U 

5 

Cz 

416 

602 

Table  53-  Classification  accuracies  obtained  for  subject  1  and  2,  test  2(TR2/CL2;0z,Pz) 


Feature 

No. 


Si  te 

Latency 

ms 

Class . 
LSDA 

Accuracy 

MS 

Feature 

No. 

Site 

Latency 

ms 

Class . 
Acc.-2 

Oz 

496 

652 

682 

1 

Oz 

496 

682 

Oz 

436 

632 

632 

2 

Oz 

456 

632 

Pz 

296 

552 

552 

3 

Oz 

156 

682 

Pz 

216 

642 

542 

4 

Oz 

316 

632 

Pz 

396 

592 

552 

5 

Oz 

596 

622 

Table  54. 


Feature 

No. 


Classification  accuracies  obtained  for  subject  1  and  2,  test  2(TR2/CL2;0z,Cz) 
LSDA  FSFS 


Site 

Latency 

ms 

Class . 
LSDA 

Accuracy 

MS 

Feature 

No. 

Site 

Latency 

ms 

Class . 
Acc . -2 

Oz 

496 

652 

682 

1 

Oz 

496 

682 

Cz 

476 

742 

752 

2 

Oz 

436 

632 

Cz 

296 

692 

682 

3 

Cz 

336 

542 

Oz 

436 

632 

642 

4 

Oz 

156 

612 

Cz 

376 

702 

662 

5 

Oz 

476 

602 

F 


electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  74%  after  2  features;  FSFS: 
68%  after  1  feature. 

Table  55.  First  and  second  subject,  second  experiment.  Data  from  second 

subject  used  to  train,  data  from  first  subject  used  to  test,  u z,  Pz  and  Cz 
electrodes  used.  ~~ 

Comments:  Maximum  classification  accuracy:  LSDA:  70%  after  1  feature;  FSFS: 
76%  after  1  feature. 

Table  56.  First  and  second  subject,  second  experiment.  Data  from  second 
subject  used  to  train,  data  from  first  subject  used  to  test.  Oz,  Pz  and  Cz 
electrodes  used. 

Comments:  Maximum  classification  accuracy:  LSDA:  74%  after  2  features;  FSFS: 
68%  after  1  feature. 

General  comments  on  Tables  50  to  56. 

An  interesting  result  from  this  series  of  tests  is  that  with  only  one 
feature  from  electrode  Pz,  the  FSFS  technique  was  able  to  correctly  classify 
over  76%  of  the  responses.  This  feature  was  located  at  a  latency  of  496  ms. 

Maximum  classification  accuracy: 

Electrode(s)  LSDA(%-#  of  features)  FSFS(%-0  of  features) 


Oz 

64(1) 

68(1) 

Pz 

76(2) 

76(1) 

Cz 

71(2) 

73(1) 

Oz,Pz 

65(1) 

68(1) 

0z,Cz 

74(2) 

68(1) 

Pz,Cz 

70(1) 

76(1) 

0z,Pz,Cz 

74(2) 

68(1) 

CONCLUSIONS 


The  general  conclusions  for  the  above  sets  of  tests  will  be  divided 
into  two  groups.  The  first  group  will  be  formed  by  those  results  obtained 
when  the  same  data  set  was  used  to  train  and  to  test  the  two  classifiers. 
The  second  group  will  be  formed  by  those  results  obtained  when  different 
data  sets  were  used  to  train  and  test  the  classifiers. 

Conclusions  for  first  group  of  tests . 

It  appears  that  both  classifiers  consistently  picked  the  "cognitive 
wave"  as  the  first  feature.  This  indicates  that  this  is  probably  the  region 
of  maximal  separability  between  the  expected  and  the  unexpected  event.  The 
results  of  two  tests  for  the  first  subject  indicate  that  the  latency  of  this 
wave  decreased  froM  575  ms  to  496  ms  between  the  first  and  second  tests. 
This  may  be  due  to  expectation  on  part  of  the  subject.  The  second  subject, 
however,  showed  a  slightly  different  result.  For  the  first  experiment,  the 
first  feature  picked  had  a  latency  of  475  ms.  Whereas  for  the  second  exper¬ 
iment  it  had  a  latency  of  496  ms. 

For  the  first  subject,  classification  accuracy  using  the  quadratic 
classifier  was  as  high  as  94%  utilizing  2  electrodes  and  five  features.  For 
the  LSDA  technique  it  was  90%  using  5  features  and  2  electrodes.  The  qua¬ 
dratic  classification  technique  outperformed  the  LSDA  technique  is  every  in¬ 
stance;  this  difference  in  performance  was  as  high  as  14%  and  as  low  as  4%. 
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Table  55.  Classi f icatlon  accuracies  obtained 

LSDA 


Feature 

Site 

Latency 

Class . 

Accuracy 

No. 

ms 

LSDA 

MS 

1 

Cz 

476 

70% 

73% 

2 

Pz 

296 

65% 

70% 

3 

Cz 

376 

68% 

68% 

4 

Pz 

576 

64% 

70% 

5 

Pz 

656 

69% 

75% 

for  subject  1 

1  and  2, 

test  2(TR2/CL2;Pz,Cz) 

FSFS 

Feature 

Site 

Latency 

Class . 

No. 

ms 

Acc. -% 

1 

Pz 

496 

76% 

2 

Pz 

576 

73% 

3 

Pz 

476 

70% 

4 

Pz 

196 

64% 

5 

Pz 

656 

66% 

Table  56.  Classification  accuracies  obtained  for  subject  l  and  2,  test  2 (TR2/CL2;0z,Cz,Pz) 


LSDA 


Feature 

Site 

Latency 

Class. 

Accurac 

No. 

ms 

LSDA 

MS 

1 

Oz 

496 

65% 

68% 

2 

Cz 

476 

74% 

75% 

3 

Cz 

296 

69% 

68% 

4 

Oz 

436 

66% 

64% 

5 

Pz 

376 

71% 

73% 

FSFS 


Feature 

Si  te 

Latency 

Class . 

No. _ 

ms 

Acc.~% 

1 

Oz 

496 

68% 

2 

Oz 

436 

63% 

3 

Cz 

336 

54% 

4 

Pz 

296 

55% 

5 

Oz 

356 

64% 

For  the  second  subject,  classification  accuracy  using  the  quadratic 
classifier  was  as  high  as  93%  using  5  features  and  3  electrodes.  For  the 
LSDA  technique  it  was  92%  using  5  features  and  3  electrodes.  As  with  the 
first  subject  the  quadratic  classification  technique  outperformed  or  was 
equal  to  LSDA  technique  in  every  instance;  this  difference  in  performance 
was  as  high  as  18%  and  as  low  as  0%. 

Features  picked  by  the  classifiers  for  the  first  experiment  were  dif¬ 
ferent  than  those  picked  for  the  second  experiment.  This  change,  probably 
due  to  habituation,  undoubtedly  affected  the  classification  accuracy  of  the 
classifiers  when  data  from  different  experiments  was  used  to  train  and  test. 
Conclusions  for  second  group  of  tests. 

Overall  performance  of  both  classifiers  deteriorated  when  data  from  one 
experiment  was  used  to  train  and  data  from  another  experiment  used  to  test 
the  classifiers.  This  result  is  the  same  whether  the  same  subject  (across 
time)  or  different  subjects  were  used.  Classification  accuracy  drops  an 
average  of  15-20%  for  both  classifiers,  although  the  LSDA  technique  shows 
slightly  better  results  than  FSFS.  As  mentioned  earlier,  this  may  be  due  to 
the  probably  sub-optimal  feature  selection  technique  used  by  FSFS. 
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